Optimal Kernel Shapes for Local Linear Regression
نویسندگان
چکیده
Local linear regression performs very well in many low-dimensional forecasting problems. In high-dimensional spaces, its performance typically decays due to the well-known "curse-of-dimensionality". A possible way to approach this problem is by varying the "shape" of the weighting kernel. In this work we suggest a new, data-driven method to estimating the optimal kernel shape. Experiments using an artificially generated data set and data from the UC Irvine repository show the benefits of kernel shaping.
منابع مشابه
THE COMPARISON OF TWO METHOD NONPARAMETRIC APPROACH ON SMALL AREA ESTIMATION (CASE: APPROACH WITH KERNEL METHODS AND LOCAL POLYNOMIAL REGRESSION)
Small Area estimation is a technique used to estimate parameters of subpopulations with small sample sizes. Small area estimation is needed in obtaining information on a small area, such as sub-district or village. Generally, in some cases, small area estimation uses parametric modeling. But in fact, a lot of models have no linear relationship between the small area average and the covariat...
متن کاملMultivariate Local Polynomial Kernel Estimators: Leading Bias and Asymptotic Distribution∗
Masry (1996b) provides estimation bias and variance expression for a general local polynomial kernel estimator in a general multivariate regression framework. Under smoother conditions on the unknown regression and by including more refined approximation terms than that in Masry (1996b), we extend the result of Masry (1996b) to obtain explicit leading bias terms for the whole vector of the loca...
متن کاملA MODIFICATION ON RIDGE ESTIMATION FOR FUZZY NONPARAMETRIC REGRESSION
This paper deals with ridge estimation of fuzzy nonparametric regression models using triangular fuzzy numbers. This estimation method is obtained by implementing ridge regression learning algorithm in the La- grangian dual space. The distance measure for fuzzy numbers that suggested by Diamond is used and the local linear smoothing technique with the cross- validation procedure for selecting t...
متن کاملSparse regularized local regression
The intention is to provide a Bayesian formulation of regularized local linear regression, combined with techniques for optimal bandwidth selection. This approach arises from the idea that only those covariates that are found to be relevant for the regression function should be considered by the kernel function used to define the neighborhood of the point of interest. However, the regression fu...
متن کاملImproved double kernel local linear quantile regression
As sample quantiles can be obtained as maximum likelihood estimates of location parameters in suitable asymmetric Laplace distributions, so kernel estimates of quantiles can be obtained as maximum likelihood estimates of location parameters in a general class of distributions with simple exponential tails. In this paper, this observation is applied to kernel quantile regression. In so doing, a ...
متن کامل